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USER INTERFACE CONVERSION SYSTEM AND METHOD 
CAPABLE OF SUPPORTING VARIOUS DEVICES 

[01] This application claims the priority of Korean Patent Application No. 
10-2003-0005568, filed on January 28, 2003, in the Korean Intellectual 
Property Office, the disclosure of which is incorporated herein in its entirety 
by reference. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[02] The present invention relates to a user interface conversion system and 
method capable of supporting various devices, and more particularly, to a user 
interface conversion system and method capable of supporting various devices 
wherein an integrated user interface is generated based on neutral user 
interfaces residing on the home network and converted into a specific user 
interface such that the integrated user interface can be supported in a client. 
This application claims the priority of Korean Patent Application No. 10- 
2003-0005568, filed on January 28, 2003, in the Korean Intellectual Property 
Office, the disclosure of which is incorporated herein in its entirety by 
reference. 

Description of the Related Art 



II 

[03] In general, a home network is configured using Internet Protocol 
(hereinafter referred to as "IP") based private networks. Thus, various kinds 
of equipment used in a home, including all types of personal computers (PCs), 
intelligent appliances and wireless devices, are connected to one another and 
controlled through a single network. 

[04] A proposed home network system is configured in such a manner that 
a common virtual computing environment called middleware is established at 
the equipment residing in the private network and applications are provided on 
the computing environment. The middleware allows various kinds of 
equipment to communicate with one another in the home network. The 
currently available middleware includes home AV interoperability (HAVi), 
universal plug and play (UPnP), Jini, home wide web (HWW), and the like. 
[05] Various kinds of equipment residing on the home network are 
connected to one another in a peer-to-peer fashion through a home network 
middleware. The respective equipment uses IP addresses that are assigned by 
a dynamic host configuration protocol (hereinafter, "DHCP") server or 
selected by an auto BP function. 

[06] That is, when the respective equipment is first connected to the home 
network, it searches for the DHCP server in order to obtain the address 
assigned in accordance with a response of the DHCP server or automatically 
selects the IP address within a certain range using the auto IP function in a 
case of a network in which the DHCP server does not operate. 
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[07] The equipment by which the IP address assigned by the DHCP server 
or selected by the auto IP function is used can communicate with other 
equipment on the network using TCP/IP and perform searches and queries for 
the other equipment on the network via the respective IP addresses. 
[08] The home network middleware such as the UPnP uses the protocol 
such as sampling stochastic dynamic programming (hereinafter, "SSDP") in 
order to search desired equipment in the home network. Further, in order to 
control the operation of the searched equipment, a web-based method is used 
in which a simple object access protocol (hereinafter, "SOAP") is used to call 
a relevant control device or a control message is transmitted through a 
presentation web page. 

[09] FIG. 3 illustrates an operation control process of accessing the UPnP 
control device residing in the conventional home network. 
[10] As shown in FIG. 3, a UPnP control point 30 searches for control 
devices such as the control device 20 for controlling various kinds of 
equipment on the UPnP home network (hereinafter, "UPnP CD") using the 
SSDP and controls the UPnP CD 20 through a SOAP request using device 
information on the searched UPnP CD 20 obtained from the search of the 
UPnP CDs 20 using the SSDP. That is, the UPnP control point 30 controls the 
equipment by calling the UPnP CD 20. 

[11] Alternatively, the UPnP control point 30 accesses a relevant control 
web page of the UPnP CD 20 through a web browser 10 using current uniform 
resource locator (URL) information corresponding to the control web page of 



the searched UPnP CD 20 obtained from the search of the UPnP CDs 20 using 
the SSDP. Then, the control point transmits an HTTP request corresponding 
to a control message for controlling specific equipment through the control 
web page provided on the web browser 10 to the UPnP CD 20, and thus, 
confirms processing results for the HTTP request in the UPnP CD 20. That is, 
if a user has access to the control web page of the UPnP CD 20 through the 
web browser 10 and selects a desired control message, an HTTP request 
message corresponding to the selected control message is transmitted to the 
UPnP CD 20. Then, the process for the HTTP request is performed at the 
UPnP CD 20 and its resultant response is received by the user. 
[12] However, there is a problem in that devices such as mobile phones or 
PDAs, which recently gained wide public exposure but have limited computer 
performance and UI display capability, have difficulty in properly executing 
the web browser or displaying the HTML pages as they are. 
[13] Further, there is another problem in that the devices on the home 
network cannot be controlled in a case where the protocols supporting the 
middleware are not compatible with one another even though the middleware 
should be used for searching and controlling the device operating on the home 
network. 

SUMMARY 

[14] The present invention is conceived to solve the aforementioned 
problems. An object of the present invention is to provide a user interface 
conversion system and method capable of supporting various devices, wherein 



an integrated user interface is generated based on neutral user interfaces for 
the devices and converted into a specific user interface for allowing the 
integrated user interface to be supported in a specific client, thereby enabling 
the support of various clients. 

[15] Another object of the present invention is to provide a user interface 
conversion system and method capable of supporting various devices, for 
enabling the access to devices on a home network through an integrated user 
interface. 

[16] According to an aspect of the present invention for achieving the 
objects, there is provided a user interface conversion system comprising a 
control device for controlling predetermined devices residing on a home 
network, and a gateway for generating an integrated user interface based on 
neutral user interfaces of the devices residing on the home network at the 
request of a user for controlling the devices and converting the generated user 
interface into a specific user interface so that the integrated user interface can 
be supported in a specific client of the user. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[17] The above and other objects, features and advantages of the present 
invention will become apparent from the following description of an 
exemplary embodiment given in conjunction with the accompanying 
drawings, in which: 
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[18] FIG. 1 is a block diagram schematically illustrating a configuration of 
a user interface conversion system capable of supporting various devices 
according to the present invention; 

[19] FIG. 2 is a flowchart schematically illustrating a user interface 
conversion method capable of supporting various devices according to the 
present invention; and 

[20] FIG. 3 is a block diagram illustrating an operation control process of 
allowing the access to control web pages for UPnP control devices within a 
conventional private network. 

DESCRIPTION 

[21] Hereinafter, an exemplary embodiment of the present invention will be 
explained in detail with reference to the accompanying drawings. 
[22] FIG. 1 is a block diagram schematically illustrating a user interface 
conversion system capable of supporting various devices according to the 
present invention. The user interface conversion system comprises a client of 
a user 100, a gateway 200, and a control device 300. 

[23] The user 100 has access to the control device 300 through the client 
and controls a home network device. Here, it can be understood that the client 
of the user 100 is a computer, a notebook computer, a PDA, a mobile phone, 
or the like. 

[24] The gateway 200 generates an integrated user interface (UI), based on 
neutral UIs for the devices residing on the home network, at the request of the 
user 100 for controlling the devices and converts the integrated UI into a 



specific UI so that the integrated UI can be supported in the client of the user 
100. The gateway 200 comprises a protocol unit 210, a device collection unit 
220, a device database 230, an integrated UI generator 240, and a UI 
conversion unit 250. 

[25] The protocol unit 210 supports a protocol for searching the devices 
residing on the home network. Here, it can be understood that the protocol is 
SSDP, lookup service of Jini, or the like. 

[26] The device collection unit 220 collects the devices including the 
neutral UIs residing on the home network. 

[27] The device database 230 is configured to store device information 
collected from the device collection unit 220. Here, the collected device 
information is meta information on the device, a URL used to access the 
neutral UIs, or the like. 

[28] The integrated UI generator 240 is configured to generate the 
integrated UI based on the device information stored in the device database 
230. That is, the integrated UI neutrally describes the UIs using an XML so 
that the integrated UI can be converted into one of many specific UI 
expressions. 

[29] The UI conversion unit 250 converts the integrated UI generated from 
the integrated UI generator 240 into the specific UI that can be supported in 
the client of the user 100. 

[30] The control device 300 is configured to control the operations of the 
predetermined devices residing on the home network. 
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[31] FIG. 2 is a flowchart schematically illustrating a user interface 
conversion method capable of supporting the various devices according to the 
present invention. 

[32] When the user 100 requests the UI conversion unit 250 to transmit the 
UI for the devices on the home network which can be supported in user's own 
client, the UI conversion unit 250 first requests the integrated UI generator 
240 to transmit the neutral UIs in response to the request of the user 100. 
[33] Then, the integrated UI generator 240 requests the device collection 
unit 220 to transmit the neutral UIs collected in the device collection unit 220, 
when receiving the request for transmission of the neutral UIs from the UI 
conversion unit 250. Accordingly, the device collection unit 220 retrieves the 
collected neutral UIs for the devices that are stored in the device database 230, 
and then, transmits the retrieved neutral UIs to the integrated UI generator 
240. 

[34] At this time, the neutral UIs are collected in the device collection unit 
220. This is performed in such a manner that the devices residing on the home 
network are searched through the SSDP and the neutral UIs for the devices are 
then collected. The device information collected from the device collection 
unit 220 (for example, the meta information about the devices, the URL 
information used to have access to the neutral UIs, or the like) is stored in the 
device database 230. Further, the meta information about the devices (for 
example, the names of manufacturing companies, types of devices, versions, 
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etc.) and positional information on the neutral UIs are stored in a table format 
in the device database 230. 

[35] In the meantime, the neutral UIs may be collected in the device 
collection unit 220 either after or before the user 100 makes a request for the 
UI. 

[36] The integrated UI generator 240 generates the integrated UI based on 
the collected neutral UIs transmitted from the device collection unit 220 and 
then transmits the generated UI to the UI conversion unit 250. Accordingly, 
the UI conversion unit 250 converts the integrated UI transmitted from the 
integrated UI generator 240 into a specific UI that can be supported in the 
client of the user 100. 

[37] Thereafter, when the UI conversion unit 250 transmits the converted 
specific UI to the client of the user 100, the integrated UI that has been 
converted into the specific UI is displayed on the client of the user 100. The 
integrated UI displayed on the client can be expressed in the form of images, 
texts, or the like. Here, the texts may be expressed in the form of a hyperlink, 
a text box, a list or the like. 

[38] When the user 100 selects (or makes a request for) the UI of a device, 
which the user wishes to control, from the integrated UI (images or texts) 
displayed on the client of the user 100, the UI conversion unit 250 requests the 
control device 300 to transmit the neutral UI for the device that the user 100 
has selected (or requested). 
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[39] Then, the control device 300 transmits the neutral UI for the specific 
device requested by the UI conversion unit 250 to the UI generator 240 which 
in turn generates the integrated UI based on the transmitted neutral UI for the 
device and transmits the generated UI to the UI conversion unit 250. 
[40] Thereafter, the UI conversion unit 250 converts the integrated UI 
transmitted from the integrated UI generator 240 into the specific UI that can 
be supported in the client of the user 100. 

[41] If the integrated UI, which has been converted into the specific UI so 
that it can be supported in the client of the user 100, is displayed on the client 
of the user 100, the user 100 can control the operation of the desired device 
using the integrated UI displayed thereon. 

[42] A method of controlling the device residing on the home network by 
the user according to an exemplary embodiment of the present invention will 
be hereinafter explained. 

[43] First, when the user 100 makes a request for the UI of the device 
residing on the home network which can be supported in his/her own client, 
the gateway 200 generates the integrated UI based on the collected neutral UIs 
and converts the generated UI into the specific UI so that the integrated UI can 
be supported in the client of the user 100. Then, the gateway 200 causes the 
converted UI to be displayed on the client of the user 100. Here, the 
integrated UI converted into the specific UI is supported in the form of the 
images or texts in the client of the user 100. That is, the home network 
devices (for example, a refrigerator, TV, audio and the like) controllable by 
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the user 100 are displayed in the form of the images or texts on the client of 
the user 100. 

[44] When the user 100 selects (or makes the request for) the UI of the 
desired device (e.g., TV) from the integrated UI displayed on the client, the 
gateway 200 requests the control device 300 to transmit the neutral UI of the 
device (e.g., TV) selected (or requested) by the user 100. 
[45] Then, the control device 300 transmits the requested neutral UI of the 
device (e.g., TV) to the gateway 200. The gateway 200 generates the 
integrated UI based on the received neutral UI and converts the generated UI 
into the specific UI so as to display the specific UI on the client of the user 
100. 

[46] Thus, the user 100 can control the operation of the specific device 
(e.g., TV) residing on the home network through the integrated UI (e.g., 
volume control, channel change, power on/off, etc.) of the specific device 
(e.g., TV) which is displayed on the client. 

[47] Table 1 below is a table showing UI elements for expressing the 
neutral UIs of the present invention in the form of tags. 

[48] In Table 1 below, the tags are classified by double lines according to 
respective UI elements. In the respective elements, unindented tags are main 
roots and indented tags represent children elements with respect to the 
respective above main roots. 
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Table 1 



Tag 


Explanation 


PaneT* 


It seems to be a single HTML page because it includes a whole UT. 


Image 


It indicates information in the form of images. If a relevant device 
cannot support the image, it should be replaced with texts. 


Information 


It corresponds to the information on the image. 


src 


Location where an actual figure will be downloaded, i.e., relative URL 


text 


It is a text displayed on the screen. If a relevant device cannot support 
the image, it should be replaced with texts. 


option 


It prescribes characteristics used for expressing the information. 


Label 


It indicates text information. 


information 


It corresponds to the information on the label. 


text 


It is a text displayed on the screen. 


option 


It prescribes characteristics used for expressing the information. 


List 


It is a choice element for allowing one menu to be selected from one or 
more menus. 


information 


It corresponds to the information on the list. 


id 


It has a value for classifying the choice elements. 


action 


URL that will be retrieved at the actual execution 


itemlist 


One or more sets of menus 


item 


Individual menus 


actionmsg 


A value that is input when the user selects 


value 


A value that corresponds to the actionmsg in an item selected by the 
user and is actually transferred 


text 


It is a text displayed on the screen. 


option 


It prescribes characteristics used for expressing the information. 


Textbox 


It receives strings from the user and executes the given operation. 


information 


It corresponds to the information on the textbox. 


id 


It has a value for classifying the textboxes. 


text 


It is a text displayed on the screen. 


action 


URL that will be retrieved at the actual input execution 


option 


It prescribes characteristics used for expressing the information. 


Button 


It executes the given operation when the UI elements in the form of 
images or texts are selected. 


information 


It corresponds to the information on the button. 


src 


Location where an actual figure will be downloaded, i.e., relative URL 


text 


It is a text displayed on the screen. If a relevant device cannot support 
the image, it should be replaced with texts. 


action 


URL that will be retrieved in order to execute the given operation when 
the image or text elements are selected 


option 


It prescribes characteristics used for expressing the information. 
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[49] * Panel: It indicates a framework including the whole UI. Thus, all the 
individual UI elements are included in the panel. 

[50] * Image: It indicates information in the form of images. It is generally 

a URL and represents a location where the image is downloaded. Here, the 

types of images to be supported vary according to user interface displays. 

[51] * Label: It indicates information in the form of texts. 

[52] * Textbox: It receives strings from the user and executes the given 

operation. 

[53] * Button: It executes the given operation when the UI elements in the 
form of images or texts are selected. 

[54] * List: If one menu is selected from several menus, it executes the 
given operation in response to the selected menu. 

[55] Reference Figure 1 shown below is an example in which the operation 
control of the home network device is described with the neutral UIs with 
reference to Table 1. 

[56] A process of controlling a washing machine residing on the home 
network by the user 100 will be hereinafter explained in Table 2. 
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Table 2 



<Panel> 
<Image> 



</Image> 
<Lable> 



</Lable> 
<List> 



<infbrrmtion> 



</information> 



<infbrmation> 



</information> 



<information> 



</List> 
<Textbox> 



</Textbox> 
<Button> 



</information> 



<infbrmation> 



</information> 



<information> 



<src > ./Washer .jpg</src > 
< text> WASHER< /text > 
<option>. ..</option> 



<text>Select washing mode of washing machine </text> 
< option>. . ,</option> 



<id>mode</id> 

<action>./node.guiml</^ction> 
<itemlist> 

<item> 



</item> 
<item> 



</item> 
<item> 



<Atem> 

</itemlist> 

< option >. ..</option> 



<id>time</id> 
<text>Time :</text> 
<action> ./dmer.GUIML</action> 
< option >. . X/option > 



<src> . A>ack. jpg</src> 

<text>BACK<text> 

< action> . /main. GUIML</action> 

<option> . . . </option> 



<actionmsg>l</actionmsg> 

< value > 1 < /Value > 

<text> 1 . Standard washing < Aext> 



<actionmsg>2</actionmsg> 

<value > 2 </Value > 

<text> 2 . Quick washing </text> 



<actionmsg>3</actionmsg> 

<value > 3 </Value > 

<text> 3 . Boiling washing </text> 



</information> 



<Button> 
</Panrl> 
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[57] When the user 100 requests that the washing machine residing on the 
home network be controlled, the neutral UT in the form of images or texts 
capable of controlling the washing machine is displayed on the client of the 
user 100. 

[58] If the user 100 selects the displayed washing machine, a UI stating 
"Select washing mode of the washing machine" is displayed on the client of 
the user 100 and another UI related to the selected washing mode (e.g., 
standard mode, quick mode, etc.) is also displayed thereon. 
[59] Thereafter, the next individual functions (e.g., boiling washing, 
spinning, number of rinse, hot/cold water setting, etc.) and time setting 
functions are displayed in response to arbitrary selection of the user 100. If 
the user selects the "boiling washing" function, a UI on which a period of time 
needed for boiling the laundry can be input is displayed. Thus, the boiling 
function of the washing machine is performed during the time period inputted 
by the user 100. 

[60] Thereafter, another UI in the form of images or texts, on which the 
other functions of the washing machine can be selected, is displayed on the 
client of the user 100. 

[61] According to the present invention, the integrated UI is generated 
based on the neutral UIs of the devices residing on the home network and 
converted into the specific UI so that it can be supported in the specific client. 
Thus, there is an advantage in that a variety of clients can be supported. 
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[62] Further, there is another advantage in that the user can have access to 
the devices residing on the home network through the integrated UL 
[63] The present invention can be embodied as a computer readable 
program that can be run by a computer, and implemented in a digital computer 
using a computer readable recording medium. Here, the computer readable 
medium may be any recording apparatus including a magnetic storage 
medium, such as read-only memory (ROM), a floppy disk, and a hard disc, 
and an optical recording medium, such as CD ROM, and DVD). Also, the 
computer readable medium may be a carrier wave that transmits data via the 
Internet, for example. 

[64] The present invention has been described in detail in connection with 
an exemplary embodiment, but it will be apparent to those skilled in the art 
that various modifications or changes may be made thereto without departing 
from the spirit and scope of the invention as defined in the appended claims. 
Therefore, mere modifications to the present invention fall within the scope of 
the present invention. 
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